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Abstract. Consider the matrix E„ = n~^l'^XnD\l'^ + P„ where the matrix 
X-n S QNxn Gaussian standard independent elements, Dn is a deter- 
ministic diagonal nonnegative matrix, and Pn is a deterministic matrix with 
fixed rank. Under some known conditions, the spectral measures of SnS* and 
•n~^ X„DnX* both converge towards a compactly supported probability mea- 
sure fj, as N and n converge to infinity at the same rate. In this paper, we prove 
that finitely many eigenvalues of S^S* may stay outside the support of fi in 
the large dimensional regime. The existence and locations of these eigenvalues 
in any compact interval outside the support of fi are studied. The fluctuations 
of the extreme isolated eigenvalues of S„S* are also analyzed. The results 
find applications in the fields of signal processing and radio communications. 



1. Introduction 

1.1. The model and the Uterature. Consider a sequence of x n matrices Yn, 

1 /2 

n = 1, 2, . . ., of the form Y„ = X„_D„ where X„ is a x n random matrix whose 
coefficients Xij are independent and identically distributed (iid) complex Gaussian 
random variables such that ^{Xn) and are independent, each with mean 

zero and variance 1/2, and where D„ is a deterministic nonnegative diagonal nxn 
matrix. Writing D„ — diag((i")j=i^...^„ and denoting by S the Dirac measure, it is 
assumed that the spectral measure Vn — 5I]j=i ^d." of £)„ converges weakly to a 
compactly supported probability measure v when n — > oo. It is also assumed that 
the maximum of the distances from the diagonal elements of D„ to the support 
supp(i^) of v goes to zero as n — > oo. Assume that N/n — > c when n — )■ oo, where 
c is a positive constant. Then it is known that with probability one, the spectral 
measure of the Gram matrix n~^YnY* converges weakly to a compactly supported 
probability measure /i (see [26], [16], [35], [36]) and, with probability one, n~^YnY* 
has no eigenvalues in any compact interval outside supp(/.t) for large n [3]. 
Let r be a given positive integer and consider a sequence of deterministic Nxn ma- 
trices P„, n = 1, 2, . . ., such that rank(P„) = r and sup„ < oo where || • || is the 
spectral norm. Consider the matrix E„ = n~^^^Yn + P„. Since the additive defor- 
mation Pn has a fixed rank, the spectral measure of S„E* still converges to ^ (see, 
e.g., [2 Lemma 2.2]). However, a finite number of "isolated" eigenvalues of S„E* 
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might stay outside the support of ^. The purpose of this paper is to character- 
ize the conditions under which this phenomenon occurs, to determine the locations 
of the isolated eigenvalues, and to study the fluctuations of the largest among them. 

The study of the isolated eigenvalues of large random matrices has a wide range 
of applications. These include detection and estimation of wireless communication 
signals |20j , fault diagnosis in complex systems |14j , financial portfolio management 
[33], or chemometrics [55]. In the statistics literature, one of the first contributions 
to deal with this subject was [23]. It raised the question of the behavior of the 
extreme eigenvalues of a sample covariance matrix when the population covariance 
matrix has all but finitely many of its eigenvalues equal to one (leading to a mut- 
liplicative fixed rank deformation). This problem has been studied thoroughly in 
[5l|6l|32]. Other contributions (see [11]) study the isolated eigenvalues of a Wigner 
matrix subject to a fixed rank additive deformation. The asymptotic fluctuations 
of the isolated eigenvalues have been addressed in [5] |33j |32l [1] [11] [121 [7] . 

Recently, Benaych- Georges and Nadakuditi proposed in [S] |9] a generic method 
for characterizing the behavior of the isolated eigenvalues for a large palette of 
random matrix models. For our model, this method shows that the limiting lo- 
cations as well as the fluctuations of the isolated eigenvalues are intimately re- 
lated to the asymptotic behavior of certain bilinear forms involving the resolvents 
{n~^YnY* — xIn)~^ and {n~^Y*Yn — xln)~^ of the undeformed matrix at real val- 
ues of X. When Z?„ = /„, the asymptotic behavior of these bilinear forms can be 
simply identified (see [9]) thanks to the fact that the probability law of y„ is invari- 
ant by left or right multiplication by unitary deterministic matrices. For general 
Dn, other tools need to be used. In this paper, these bilinear forms are studied with 
the help of an integration by parts formula for functionals of Gaussian vectors and 
the Poincarc-Nash inequality. These tools belong to the arsenal of random matrix 
theory, as shown in the recent monograph [31j and in the references therein. In 
order to be able to use them in our context, we make use of a regularizing function 
ensuring that the moments of the bilinear forms exist for certain x S R+ = [0, oo). 

Before entering the subject, we remark that the results of the paper can be 
straightforwardly generalized to the case where Dn is replaced by a nonnega- 
tive Hermitian matrix which is a more practical model in many applica- 

1/2 

tions. Indeed, write i?„ — VnDnV* where is a unitary matrix, and let i?„ ~ 
VuDI/^V* . Then the singular values of I]„ = n^^^'^XnOl/^ + P„ coincide with 
those of n-i/2(x„y„*)i?y' + P^V*. Since X„ and XnV* are equal in law, the vec- 
tor of singular values of I]„ and the vector of singular values of n~^^'^XnRn^ + Pn 
where P^ ~ PnV* are also equal in law. 

The paper is organized as follows. The assumptions and the main results are 
provided in Section [2] Section [3] is devoted to the basic mathematical tools needed 
for the proofs. These proofs are provided in Sections |4] and (5] which concern respec- 
tively the first order (convergence) and the second order (fluctuations) behavior of 
the isolated eigenvalues. 
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2. Problem description and main results 

Given a sequence of integers N = N{n), n = 1, 2, . . ., we consider the sequence 
of X 71 matrices S„ = n"^/^y„ + P„ = n^^/'^XnOl/^ + Pn with the following 
assumptions: 

Assumption 1. The ratio c„ = N{n)/n converges to a positive constant c as 
n oo. 

Assumption 2. The matrix Xn = is a N x n random matrix whose 

coefficients Xij are iid complex random variables such that ^(Xn) and are 
independent, each with probability distribution Af{0, 1/2). 

Assumption 3. The sequence ofnxn deterministic diagonal nonnegative matrices 
Dn = diag((i")"^]^ satisfies the following: 

(1) The probability measure Un — X]j=i ^rf" converges weakly to a probabil- 
ity measure v with compact support. 

(2) The distances (i(c?", supp(j/)) from c?" to supp(i/) satisfy 

max d (d", supp(j/)) > 0. 

je{l,...,n} ■' n->oo 

This assumption implies that d^ax = sup„ HZ^nlj < oo. 

As is usual in random matrix theory, a central role will be played here by the so 
called Stieltjes Transform. The Stieltjes Transform of a positive finite measure /i 
over the Borel sets of M is the function 

m(z) - / -^^Ji{dt) (1) 

analytic on C — supp(/i). It is straightforward to cheek that 3to(z) > when z G 
C+ — {z : 3(2;) > 0}, and sup^^g \ym{iy)\ < 00. Conversely, any analytic function 
m{z) on C+ that has these two properties admits the integral representation ([!]) 
where /i is a positive finite measure. Furthermore, for any continuous real function 
if with compact support in R, 

/Lp{t) ii{dt) = — lim / Lp{x)'^m(x + ly) dx (2) 
TT yio J 

which implies that the measure /x is uniquely defined by its Stieltjes Transform. 
Finally, if ^{zm{z)) > when z S C+, then n{{-oo, 0)) = [H]. 
These facts can be generalized to Hermitian matrix-valued nonnegative finite mea- 
sures [inilll]. Let m{z) be a C^''-valued analytic function on z E C+. Letting 
QX = {X - X*)/(2i), assume that 9m(z) > and 3(zm(z)) > in the or- 
der of the Hermitian matrices for any z G C+, and that sup^^^g ||j/m(2j/)|| < 00. 
Then m(z) admits the representation ([1]) where fi is now a r x r matrix-valued 
nonnegative finite measure such that ^((— oo,0)) = 0. One can also check that 
//([0,oo)) -\iiTiy^ooWm-i-w)- 

The following theorem characterizes the asymptotic behavior of the eigenvalues 

of 7i-iy„y„*: 

Theorem 2.1. Under Assumptions]^ [H and\3i the following hold true: 
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(1) For any z G C+, the equation 

+ (3) 

admits a unique solution m G C-(-. The function m = m(z) so defined on 
C+ is the Stieltjes Transform of a probability measure fi whose support is a 
compact set o/M+. 

Let (A")i=i_....Af be the eigenvalues of n^^YnY* , and let On ~ N^^ SiLi ^A" 
be the spectral measure of this matrix. Then for every bounded and contin- 
uous real function f , 

f f{t)e^{dt) f f{t)pi{dt). (4) 

(2) For any interval [xi,X2\ C M — supp(/i), 

: A" S [a;i,a;2]} ~ with probability 1 for all large n. 
The first part of this theorem has been shown in |26i 136] , and the second part in 

Let Qn{z) = {n ^YnY*~-zlN) ^ and Qn{z) = {n ^F„*F„-z/„) ^ be the resolvents 
of n^^YnY* and n^^Y*Yn respectively. The first part of Theorem 12.11 can also be 
deduced from the following result that will be used in our subsequent derivations: 

Proposition 2.1 (|36 1 122 1 Assume that Z?„ is a nx n diagonal nonnegative 
matrix. Then, for any n, the equation 

where fn = [-z (/„ + c„m„Ai)]~"^ 

admits a unique solution m„ G C+ for any z G C+. The function m„ = mn{z) 
so defined on C+ is the Stieltjes Transform of a probability measure /i„ whose 
support is a compact set o/R-f. Moreover, the nxn diagonal matrix-valued function 
r„(z) = [— z(/„+c„m„(z)£'„)]^^ is analytic on C+ and n^^ TtT„ {z) coincides with 
the Stieltjes Transform of CnP^n + (1 — c„)<5o. 

Let Assumption\^hold true, and assume that sup„ ||-D,i|| < oo, and < liminf c„ < 
lim sup c„ < oo . Then 

4Tr(g„(z)-m„(z)/w) -^^0 and - Tr (q„(z) - T„(z)) (5) 

for any z G C+. When Assumptions\^and\^hold true, m„(z) converges to m(z) 
provided in the statement of Theorem \2.1\ uniformly on the compact subsets of C+ . 

The function 77i„(z) = (—2 + + Cnmn{z)t)^^Vn{dt)) ^ is & "finite horizon" 
analogue of m(z). Since iV^^Tr(5„(z) is the Stieltjes Transform of the spectral 
measure 6'„, Convergence (|4]) stems from the first convergence in ([5]). Note that 
n~^Tr(5„(z) is the Stieltjes Transform of c„6'„ + (1 — c„)(5o. Hence Convergence 
(j4]) can also be deduced from the second convergence in ([5|). 

We now consider the additive deformation P„: 

Assumption 4. The deterministic Nxn matrices Pn have a fixed rank equal to 
r. Moreover, Pmax = sup„ ||P„|| < 00. 



-z\ 1 + -Ti- DnT„ 
n 
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In order for some of the eigenvalues of SnS* to converge to values outside 
supp(/x), an extra assumption involving in some sense the interaction between P„ 
and Dn is needed. 

Let Pn — UnRn bc a factorization of P„ where C/„ is an isometry matrix of size 
N X r, e.g., a QR factorization. Define the r x r Hcrmitian nonnegative matrix- 
valued measure A„ as 



It is clear that the support of A„ is included in [0,dinax] and that A„([0, dmax]) < 
Pmax-^r- Since the sequence A„([0, dmax]) is bounded in norm, for every sequence 
of integers increasing to infinity, there is a subsequence Uk and a nonnegative finite 
measure A^, such that / fdAn^ — >■ / fdA^ for every function / S C([0,dmax]), with 
C([0, d„iax]) the set of continuous functions on [0,dmax]- This fact is a straightfor- 
ward extension of its analogue for scalar measures. 

Assumption 5. Any two accumulation points Ai and A2 of the sequences A„ 
satisfy Ai(dx) = UA2{dx)U* where U is a unitary matrix. 

An equivalent statement of this assumption, perhaps more easily verifiable in 
some applications, is the following: there exists a sequence of factorizations P„ = 
UnRn such that for every function / G C([0,dmax]), the sequence of measures A„ 
associated to these factorizations by ([6]) satisfies / fdAn — > / fdA^ where A* is a 
matrix-valued nonnegative finite measure. 

It is shown in [37) that the limiting spectral measure /z has a continuous density 
on R* = R— {0} (see Prop. l3.1l below). Our first order result addresses the problem 
of the presence of isolated eigenvalues of E„E* in any compact interval outside the 
support of this density. Of prime importance will be the r x r matrix functions 



where A^ is an accumulation point of a sequence A„. Since |1 + cm(z)i| ~ \z{l + 
cm{z)t)\/\z\ > |5(z(l + cm{z)t))\/\z\ > 3(z)/|z| on C+, the function H^{z) is 
analytic on C+. It is further easy to show that 3(i/*(z)) > and 3(z7J*(z)) > 
on C-I-, and sup^^^o Il2/^*(*y)ll < Hence H^,(z) is the Stieltjes Transform of a 
matrix- valued nonnegative finite measure carried by [0,oo). Note also that, under 
Assumption [51 the eigenvalues of H^,(z) remain unchanged if A* is replaced by 
another accumulation point. 

Theorem 2.2. Let Assumptions[ll[^ and[3i hold true. Denote by {X^)i=i^...^N the 
eigenvalues o/I]„S]*. Let (a, 5) be an interval in supp(/x)'^ = M — supp(/i) such that 
a belongs to the boundary dswpj>{fi) or a ~ 0, and b G 9supp(/i) or b = 00. Then 
the following facts hold true: 

(1) Let (Pn) be a sequence satisfying Assumptions^ and\^ Given an accumu- 
lation point A^: of a sequence An, let H^,(z) ~ J m{z){l + cm{z)t)~^A^{dt). 
Then H^{z) can be analytically extended to {a,b) where its values are Hcr- 
mitian matrices, and the extension is increasing in the order of Hermitian 



An — Rn 



(6) 



Sd: 
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matrices on {a,b). The function = det{H^{x) + Ir) has at most r 

zeros on (a, h). Let pi, . . . , pk, k < r be these zeros counting multiplicities. 
If k > I, let [a' ,b'] C (a, 6) he such that [pi,Pk] C (a',&')- V k = 0, let 
[a' , b'] be any closed interval in (a, b). Define the functions C{x) and Cn{x) 
on [a', b'] as 

C{x) = tt{i : p, < x} and dn{x) = tt{i : A^' G [a', b'] and < x}. 
Then 



h' 



Cn{x)-C{x) 



dx — '—^ 0. 



(2) Ifb = inf (supp(/i) — {0}), then for any positive b' < b and for any sequence 
of matrices (P„) satisfying Assumption^ 

: A" G (0, b']} = with probability 1 for large n. 

(3) Assume a > inf (supp(/^) — {0}). Then for any pi < ■ ■ ■ < Pr in (a, b), there 
exists a sequence of matrices Pn satisfying Assumptions^ and\^ for which 
la' \C^n{x) — C{x)\ dx 0, where [a',b'] C (a, fc) and [pi,pr] C {a',b'), and 
where C{x) and Cn{x) are defined as above. 

Hence, for n large, S„E* cannot have isolated eigenvalues before the first "bulk" 
of eigenvalues, i.e., the first interval of the support of p. Alternatively, between any 
two bulks or after the last bulk of this support, the number of isolated eigenvalues 
of S„E* can reach the rank of the additive deformation. 

It would be useful to complete the results of this theorem by specifying the in- 
dices of the isolated eigenvalues that appear between the bulks. This study (not 
done in this paper) may be done by following the ideas of [11] or [38] relative to the 
so called separation of the eigenvalues of S„S* . Another approach dealing with 
the same kind of problem is developed in [4] . 



In a few words, the proof of Theorem 12.21 consists in showing that the isolated 
eigenvalues of Sn^n {^^ ^) ^-^^ close for large n to the zeros of det(G„(a;) + In) 
in this interval, where Gn{x) is the analytic extension of G„(z) = mn{z)Pn{I + 
Cn'fnn{z)Dn)~^P* to (fl, 6). Performing a factorization P„ = UnRn where C/„ is 
an isometry matrix of size iV x r, we observe that G„(z) can be represented in an 

orthonormal basis of whose first vectors arc the columns of C/„ as ^"^^-^ ^ 

[0 

where IIn{z) = TO„(2:)i?* (/ + c„m„(2:)I?„)~^i?„. These functions can be written as 

and we shall show that they admit the H^{z) as uniform limits on the compact 
subsets of C — supp(/i). In practice, the isolated eigenvalues for a given large n can 
be approximated by the zeros of det(m„(a;)i?* (/-|-c„m„(a;)£'„)~^i?„ -\-Ir) in (a, b). 

A scenario of practical importance at least in the fields of signal processing and 
wireless communications is provided by the following assumption. Recall that v is 
the probability measure given by Assumption [31 
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Assumption 6. The accumulation points A* are of the form v{dt) x UQ.U* whe 



■coll,. 



>0, 



Ji 



Jt 



and where U is a unitary matrix. 

In wireless communications, the uif typically represent the powers of radio sources 
transmitting signals to an antenna array. 

Observe from Proposition [Q that J {1 + cm.{z)ty^iy{dt) = -z\im{n^^ Trf„{z)) = 
— czm(z) + 1 — c. Consequently, in this particular case, H^{x) is unitarily equiva- 
lent to — m(x) {cxm{x) — 1 + c) O on (a, h). This brings the following corollary of 
Theorem [O 



Corollary 2.1. Assume the setting of Theorem ] 2. 2\ -^ . and let Assumption\d\hold 
true. Then the function g{x) = m(a;) (cxm(a;) — 1 + c) is decreasing on (a, b). De- 
pending on the value of ujj , £ ~ 1, . . . ,t, the equation ujjg{x) = 1 has either zero or 
one solution in (a, b). Denoting by pi, . . . , ps these solutions counting multiplicities, 

J^i \Cn{x) — C{x)\ dx 0, where a' , b' , Cn{x) and C{x) are built as in the statement 
of Theorem\23-^. 



We now turn to the second order result. This result will be stated in the sim- 
ple and practical framework of Assumption [6l Actually, a stronger assumption is 
needed: 

Assumption 7. The following facts hold true: 

sup y/ri\Cn — c\ < OO, 



lim sup - 



1 



-iy„{dt) 



1 



-v{dt) 



< OO for all X G 



supp(i^). 



t — X J t — X 

Moreover, there exists a sequence of factorizations of Pn such that the measures A„ 
associated with these factorizations by ^ converge to v{dt) x Jl and such that 

-Kn{dt) - / v{dt) X n 



lim sup 1 



t- 



t 



< OO for all X €z R — supp(i^) 



Wc recall that a GUE matrix (i.e., a matrix taken from the Gaussian Unitary 
Ensemble) is a random Hermitian matrix G such that Gu ~ A^(0, 1), 3ff(Gy ) ^ 
A/'(0,l/2) and 3(Gy) ~ A/'(0, 1/2) for i < j, and such that ah these random 
variables arc independent. 

Theorem 2.3. Let Assumptions{Tj^hold true. Let g be the function defined in the 
.statement of Corollaru \2.1\ and let = sup(supp(/i)). Assume that the equations 
ujfg{x) = 1 with X G {B^,oo), have a solution for each £ G {!,..., p}, p < 1, 
denoted pi > ■ ■ ■ > pp (with multiplicities Ji, . • . ,jp), respectively. Let A„ be any 
sequence of measures satisfying the third item of Assumption^ and let Hn{z) be the 
matrix function associated with A„ by ([7]). Denote by Hi n{z), . . . ,Hp n{z) the first 
p upper left diagonal blocks of Hn{z), where Hi niz) G O'^^'. Then the following 
facts hold true: 



A(p.) = l-c J 



m(pj)t 
f cm{p.i)t 



v{dt) is positive for every i = 1, 



,P- 
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• linisup„ \\^/n{Hi^ri{Pi) + IjM < oo for every i = l,...,p. 
For i = 1, . . . ,p, let 



Mr 





'I 


- Pi 






1 



where jo ~ and where the eigenvalues A" of S„E* are arranged in decreasing 
order. Let Gi, . . . , Gp be independent GUE matrices such that Gi is a ji x ji matrix. 
Then, for any bounded continuous f: M-^i+'-'+^p — > R. 



where S" g 
matrix 



where 



E[/(A/r,...,Af;)]-E[/(sr,...,5;)] -^0 

is the random vector of the decreasingly ordered eigenvalues of the 
1 



^2 ^ 



MPi 



^fgiPi) 



r + 2ujft 
(1 + cm{p,)ty 



7 (Q;iG^ + Vn {Hi,n[pi) + /jj) 



p,uj1m.{pi)t 



y{dt) 



Before turning to the proofs, some comments can be useful. We shall see that 
the results of Theorems 12.21 and 12.31 are intimately related to the first and sec- 
ond order behaviors of bilinear forms of the type M*(3„(a;)w„, u*^Qn{x)vm and 
n~^/^u*^YnQn{x)vn whcre u„, f„, Un and are deterministic vectors of bounded 
norm and of appropriate dimensions, and where a; is a real number lying outside the 
support of p. In fact, it is possible to generalize Theorem l2.2l to the case where the 
elements of X„ are not necessarily Gaussian. This can be made possible by using 
the technique of [21) to analyze the first order behavior of these bilinear forms. 
On the other hand, the Gaussian assumption plays a central role in Theorem 12.31 
Indeed, the proof of this theorem is based on the fact that these bilinear forms 
asymptotically fiuctuatc like Gaussian random variables when centered and scaled 
by \/n. Take u„ = eijv and = ei_„ where ek,m is the fc*'' canonical vector of 
M™. Denoting by and by f^j the (i, j) elements of Qn{x) and Tn{x) respectively, 
we can informally write 



1/2 



J=2 



following [51]. It can be shown furthermore that f"]^ = 0(1) for large n and that 
the sum X]J=2 tight. Hence, j^YnQ{x)ei^n is tight. However, when Xn is 
not Gaussian, we infer that ej j^YnQ{x)ei^n does not converge in general towards 
a Gaussian random variable. In this case, when P„ ~ w^euve^^ „ (sec Section [5]), 
Theorem 12.31 no longer holds. Yet, we conjecture that the results of this Theorem 
can be recovered when ci^n and ei,n are replaced with vectors whose elements are 
"spread enough" , see [12] which deals with a similar problem. 
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A word about the notations. In the remainder of tlie paper, we sliall often drop 
tiie subscript or tlie superscript n wlien there is no ambiguity. A constant bound 
that might change from an inequality to another but which is independent of n will 
always be denoted K. Element of matrix M is denoted Mij or [M]ij. Element 
i of vector x is denoted [x]i. As usual, A* means the adjoint of a matrix or a vector 
A, and for a complex number z, we will use either z or z* to denote the complex 
conjugate of z. Convergence in probability will be denoted — >, and convergence 
in distribution 



3. Mathematical tools and useful results 
We start this section with some basic mathematical tools. 



3.1. Differentiation formulas. Letd/dz= {d/dx—td/dy)/2andd/dz = {d/dx+ 
id/dy)/2 for z = x + ly. Given a Hermitian matrix X with a spectral decompo- 
sition X = J^i^f'^f'^h 9'dj(A) = J^kiYliyik ^i)''^kvl be the classical adjoint of 
A, i.e., the transpose of its cofactor matrix. Let -0 be a continuously differentiable 
real- valued function on K. Then 



ddct Tp{n-^YY* 



[adj (V' (n-^YY*)) i)' {n-^YY*) y,] 



where yj is column j of y, see [191 Lemma 3.9] for a proof. 

We shall also need the expressions of the following derivatives of the elements of 
the resolvents Q and Q (see [IH]): 



dQ 



pq 



1 



dY, 



\QY'\pjQiq, 



dQ 



pq 



dY,, 



^--QpAYQ] 



Jig- 



3.2. Gaussian tools. Our analysis fundamentally relies on two mathematical tools 
which are often used in the analysis of large random matrices with Gaussian ele- 
ments. The first is the so called Integration by Parts (IP) formula for functionals of 
Gaussian vectors introduced in random matrix theory in [Ml EQ] . Let F : M^^" C 
be a continuously differentiable function polynomially bounded together with its 
partial derivatives. Then 



E(r,,r(y)) 



dT{Y) 
dYii 



for any i £ {1, . . . , N} and j <S {1, . . . , n}. The second tool is the Poincare-Nash 
inequality (see for instance |13|). In our situation, it states that the variance 
Var(r(y)) satisfies 



N 



Var(r(r))<^^d, 



i=l j=l 



dT{Y) 



dY, 



dViY) 



BY, 



The results of Silverstein and Choi [37] relative to the support of fi will be needed 
in the proof and recalled in the following paragraph for completeness. Close results 
can be found in |27| and in [28l. 
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3.3. Analysis of the support of ^i. 

Proposition 3.1 ([33, Th.1.1). For all x G M*, lim m(z) exists. The limit 

that we denote m(a;) is continuous on R*. Moreover, fj. has a continuous density f 
on M* given by f{x) = Tr^^Qm{x). 

In |37| . the support of yu is also identified. Since m(z) is the unique solution in 
C-i- of ^ for z e C+, it has a unique inverse on C+ given by 

1 f t 
z(m) = h / i^{dt) 



m J 1 + cmt 

The characterization of the support of fi is based on the following idea. On any open 
interval of supp(/x)'^, m(a;) = J{t — x)^^^{dt) is a real, continuous and increasing 
function. Consequently, it has a real, continuous and increasing inverse. In [37], 
it is shown that the converse is also true. More precisely, let B = {m : m 7^ 
0, — (cm)^^ e supp(i/)^}, and let 

X : B — > R 

m xim)^-—+ I ^ v{dt). 

^ ' m J 1 + cmt ^ ' 

Then the following proposition holds: 

Proposition 3.2 ([37], Th. 4.1 and 4.2). For any xq G supp(/i)'^, let mo = m(a::o). 
Then mg G B, xq — x^uiq), and .T'(mo) > 0. Conversely, let mo G B such that 
x'(mo) > 0. Then xo = a;(mo) G supp(/i)'^, and m(a;o) = mg. 

The following proposition will also be useful: 

Proposition 3.3 ([37., Th. 4.4). Let [mi,m2] and [m3,m4] be two disjoint in- 
tervals of B satisfying Vm G (mi,m2) U (m3,m4), a;'(m) > 0. Then [xi,X2] and 
[x3,X4] are disjoint where Xi = x(m.i). 

The following result is also proven in [37] : 

Proposition 3.4. Assume that i^{{0}) = 0. Then IJ.{{0}) = max(0, 1 — c^^). 

We shall assume hereafter that i'({0}) = without loss of generality (otherwise, 
it would be enough to change the value of c). The two following lemmas will also 
be needed: 

Lemma 3.1. Let [xi,X2] G supp(/i)'^ with xi > 0, and let Dx^^x2 be the closed 
disk having [xi,X2] as one of its diameters. Then there exists a constant K which 
depends on xi and X2 only such that 

G supp(z^), Vz G -D^^i^xai \l + cTca{z)t\ > K , and 
V?! large enough, yt G supp(zy„), Vz G Dx^^x2i |1 + c,im„(z)t| > K. 

From the second inequality, we deduce that Tn {z) is analytic in a neighborhood 
of [xi, X2] for n large enough, and 

lim sup sup ||T„(z)|| < 00. (9) 
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Proof. When z e C+, 5m(z) > and 5(— (cm(z))^^) > 0, and we have the 
opposite inequaUties when 5z < 0. Applying Proposition 13.21 for z £ [xi,X2], we 
deduce that |m(z)| and f{z) = d{—{cm{z))~^ ,supp(i^)) are positive on Dxi.x2- 
Since these functions are continuous on this compact set, min|m(2;)| = Ki > 
and min/(z) = K2 > on Dx^^x2- Consequently, for any z G Dx^.x2 ^-iid any 
t e supp(i/), |1 + cm{z)t\ = |cm(z)(-(cm(z))-i - *)! > |cm(z)|/(z) > CK1K2 > 0. 
We now prove the second inequality. Denote by d-ii(A,B) the HausdorfF distance 
between two sets A and B. Let fn{z) = (c„m„(z))~^, supp(^'„)). We have 

fn{z) < d( 5--, ^) +d( ^,supp(zy„) 

< d( ^) + f{z) + dH(supp(i/„), supp(z^)), 

\c„mn{z) cm(z)/ 

and f{z) < d(-(c„m„(z))"\-(cm(z))"i) + /„(z) + dH(supp(z^„), supp(i')) sim- 
ilarly. Since m„(z) converges uniformly to m(z) and inf |m(z)| > on Dx^^x^^ 
d(— (c„TO„(z))~-'^, — (cm(z))~^) —J- uniformly on this disk. By Assumption |3J 
dH(supp(t'„), supp(;y)) 0. Hence /„(z) converges uniformly to f{z) on 0x^^x2 
which proves the second inequality. □ 



Lemma 3.2. In the setting of Lemma \3.1\. for any sequence of vectors Un G C" such 
that supjj \\un\\ < 00, the quadratic forms u*r„(z)?i„ are the Stieltjes Transforms 
of positive measures 7„ such that sup„7„(R) < cxd and 7n([a;i, 2:2]) = for n large 
enough. 

Indeed, one can easily check the conditions that enable 'u*T„(z)u„ to be a Stielt- 
jes Transform of a positive finite measure. The last result is obtained by analyt- 
icity in a neighborhood of [a;i,a;2]. In fact, it can be checked that supp(7„) C 
supp(^„) U {0}. 

3.4. A Control over the support of 6'„. In this paragraph, we adapt to our case 
an idea developed in to deal with Wigner matrices whose elements distribution 
satisfies a Poincare-Nash inequality. 

Proposition 3.5. For any sequence of n x n deterministic diagonal nonnegative 
matrices Un such that sup„ \\Un\\ < 00, 



- TrEQ„(z) - m„(z) 
n 



- Tr C/„EQ„(z) - i Tr [/„r„(z) 
n n 



^ P(|z|)J?(|5(z)|-i) 

< 5 , and 

P(|z|)i?(|3(z)|-i) 



< 



for z € C_)_, where P and R are polynomials with nonnegative coefficients indepen- 
dent of n. 

This proposition is obtained from a simple extension of the results of [18[ Th. 3 
and Prop. 5] from z S (— oo,0) to z G C+. 

The following important result, due to Haagerup and Thorbj0rnsen, is established 
in the proof of ^ Th.6.2]: 

Lemma 3.3. Assume that h(z) is an analytic function on C+ that satisfies \h{z)\ < 
P{\z\)R{\Q{z)\~^) where P and R are polynomials with nonnegative coefficients. 
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Then for any function ip £ C^(R, R), the set of smooth real-valued functions with 
compact support in M, 



Since N -'^TrQ„(z) is the Stieltjes Transform of the spectral measure the 
inversion formula ([2]) shows that 

/ ip{t) 9n{dt) = - lim3 / ipix)— TrQn{x + ly) dx 
J TT yio J I\ 

for any function if E (R, M) . Using then Proposition 13.51 and Lemma 13. 3[ we 
obtain the following result: 

Proposition 3.6. For any function ip G C^(R,M), 



In all this section, [xi, X2] is an interval in (a, h) where a and b are given in the 
statement of Theorem 12.21 and z is a complex number such that '^{z) € [xi,X2\ 
and is arbitrary. Moreover, u„,w„ S and Un,Vn G C" are sequences of 
deterministic vectors such that sup„ max( 1 1 u„ 1 1 , 1 1 f n 1 1 , 1 1 1 1 , 1 1 'i'n 1 1 ) < 00, and J7„ is a 
sequence of n x n diagonal deterministic matrix such that sup„ \\Un\\ < 00. 
We now introduce the regularization function alluded to in the introduction. Choose 
e > small enough so that [a;i,X2] n & = where = {x E R, d(a;, supp(/^) U 
{0}) < e}. Fix < e' < e, let : R ^ [0,1] be a continuously diffcrentiable 
function such that 



and let ipn = det'0(n ^YnY*). In all the subsequent derivations, quantities such 
as u*(5„(z)m„ or u^Qn{z)un for 3?(z) € [xi,a;2] will be multiplied by in order 
to control their magnitudes when z is close to the real axis. By performing this 
regularization as is done in |19| , we shall be able to define and control the moments 
of random variables such as 4>nUnQniz)un or (f>nU'!^Qniz)un with the help of the 
Gaussian tools introduced in Section 13.21 

We start with a series of lemmas. The first of these lemmas relies on Proposition 
13.61 and on the Poincare-Nash inequality. Its detailed proof is a minor modification 
of the proof of [191 Lemma 3] and is therefore omitted: 

Lemma 4.1. Given < e' < e , let if be a smooth nonnegative function equal to 
zero on S^' and to one on R — 5e . Then for any £ € N, there exists a constant Ki 
for which 



hmsup / ip{x)h{x + iy)dx < 00. 





4. First Order Analysis: Proof of Theorem 12.21 




E (TV^(n-iy„r„*)) < 




Remark 1. Notice that this lemma proves Theorem \2.1\ -^ . The proof provided in 
[3] is in fact more general, being not restricted to the Gaussian case. 
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Lemma 4.2. For any £ Cz N, the following holds true: 



E 



N,n 



BY,, 



< 



,21 ■ 



Proof. Letting n ^I'^Y = diag(VAi, • • • , -s/Aat)!^* be a singular value decompo- 
sition of tT^I'^Y ^ wc have 

adj U(^) ) = W^V* where S = diag(VAfeV'(Afe) J] ^(^f)) _ 

and we observe that TrS^ < KZn where Z„ = tJ{fc : G 5^ — S^'}. Using the 
first identity in Section [Q and recalling that |Tr(AB)| < Tr B when A is a 
square matrix and is a Hermitian nonnegative matrix, we have 



E 



N,n „, 2' 



OY, 



YDY* 

Tr ( adj(V')^/'' adj(^/')V'' 



and the result follows from Lemma |4. II with a proper choice of (p. 
Lemma 4.3. The following inequalities hold true: 

K 



□ 



E 



(f>n U*nQniz)Vn ~ E[(j>n U* (3„(z)f)„ 

Var(0„TrQ„(z)) < K. 



4 K 



Proof. We shall only prove the first inequality. By the polarization identity, this 
inequality is shown whenever we show that E \(j)u*Qu — K[(j)u*Qu 

]| < K/n'^. Let 

us start by showing that Ya,r{(j>u*Qu) < K/n. By the Poincarc-Nash inequality, 
we have 

N,7l 

Ya.T{(f)u*Qu) < 2 ^ djE 

ij = l 
N.n 

< 4 E ^J-^ 

ij = l 



OY, 



, du*Qu 



dY,, 



u*Qu 



dYu 



Using the expression of dQpq/dYij in Section [3Jl we have 

du*Qu/dYij ~ —n^^u*Qyj [Qu]i, 

hence 



du*Qu 


' 1^ 
= -E 




71 



YDY* 

u*Q Quu*Q^u 

n 



< 



since the argument of the expectation is bounded for 5R(z) £ [xi, X2]. From the first 
identity in Section O ^ ^ djE\d(l)/d%jf which 
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is bounded by Kjr? by Lemma [4.21 It results that Yai{(j)u*Qu) < K/n. Now, 
writing X ~ EX, 



E 



(j)u*Qu 



By the Poincare-Nash inequahty, 

1 2 

^— ^ , du*Qu 



N,n 

< 16 ^ djE 

ij = l 



+ 16 ^ djE (j)u*Qu u*Qu 



— V1 + V2. 



By developing the derivative in Vi similarly to above, Vi < A'n^^E 
Kn~^. By the Cauchy-Schwarz inequality and Lemma l4.2i 



4>u*Qu 



2 K 



4\ 1/2 



< 



Writing a„ 



, we have shown that ^Ja^ < K/y/a^ + K/n. Assume 



that a„ is not bounded. Then there exists a sequence Uk of integers such that 
— ^ 00, which raises a contradiction. The first inequality in the statement of 
this lemma is shown. The other two inequalities can be shown similarly. □ 

Lemma 4.4. The following holds true: 

1 - E(j)n < -J for any £ e N. 

Proof. For < ei < e' where e' is defined in the construction of t/i, let iy9 be a 
smooth nonncgative function equal to zero on Se^ and to one on M — S^'. Then 
~ 4>n < (Tr(iy9(n~^yy*))) for any £ g N, and the result stems from Lemma 
01 □ 



Lemma 4.5. The following inequalities hold true (recall that 9fi(z) ^ supp(/x)J.- 



|E[(/)„TrQ„(z)]-iVm„(z)| < — , 

n 



and 



TrC/„ E[0„Q„(z)]-T„(z) 



< 



K 



Proof. Let e be defined in the construction of ip. Choose a small ei > e in such a 
way that S^^ n [xi, 0:2] = 0. Let ^ be a C^(R, M) nonnegative function equal to one 
on Se and to zero on M — , so that 



!)-TrO 



t - z 



.(dt) . 



Using this equality, and recalling that (/) e [0, 1], we have 



E^- Tr Q - E 
n 



at) 



.(dt) 



< E 



(1 



t~ z 



Adt) 



< 



1 



d{z,S,,) 



< 
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for any ^ e N. Moreover, we have 

K 



E / ^0„(dt)-m„(z) 
' t — z 



t^Z ' t 



< 

V? 



by Proposition 13.31 and the first inequality is proved. 

By performing a spectral factorization oin^^Y*Y , one can check that n^^ Tr UQ{z) 
is the Stieltjes Transform of a positive measure t„ such that sup„r„(]R) < cio and 
supp(r„) C supp(0„)U{O}. By Lemma [5?^ TrUT{z) is the Stieltjes Transform 
of a positive measure 7„ such that sup„7„(R) < oo and 7n([xi,X2]) = for all 
large n. With the help of the second inequality of Proposition l3.5[ we have a result 
similar to that of Proposition [321 namely that |E / (fdrn — J (pd^n\ < K/n"^ for any 
function ip £ (M, E) . We can then prove the second inequality similarly to the 
first one. □ 

Lemma 4.6. The following inequalities hold true: 

|E[(^„u*(3„(z)u„] -u*u„m„(z)| < K/n, 
E[(/)„-!i*Q„(z)w„] - u*r„(z){;„ <K/n. 

In |21| . it is proven in a more general setting that |Ew* (5n(2;)un — |lti„|pm„(z)| < 
P{\z\)R{\'^{z)\~^) / ^Jn ioT any z S C+. Observing that u*^Qn[z)un and ||u„|pm„(z) 
are Stieltjes Transforms of positive measures, and mimicking the proof of the pre- 
vious lemma, we can establish this lemma with the rate 0{n~'^/'^), which is in fact 
enough for our purposes. However, in order to give a flavor of the derivations that 
will be carried out in the next section, we consider here another proof that uses 
the IP formula and the Poincare-Nash inequality. To that end, we introduce new 
notations: 

= 0„iTrQ„(z), a(z)=E/3(z), /3(z) = /3(z) ^ (/)„a(2), and 
n 

a{z) = - Tr + a{z)D,,)]-\ 

n 

Proof. We start with the first inequality. By the IP formula, we have 

Taking the sum over i, we obtain 

mQyj]p%,4>] = -djE[[Q%]p?o-/3] + d,E[Qp^(A] + ^E[y,j[Qadj(V')V''2/j]p]- 



n 



Writing /? = /3 + (/)a, we get 



i + adj i + adj 

di 



-v 



n{l + adj) 



E[%,[Q^dmi''y,]p] 
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Taking the sum over j, we obtain 



E 

















n 


pi 



E 



Q 



YD{I + aD)-^Y* 



pi 



-E 



'adj(V')V'' 



,YD{I + aD)-^Y* 



pe 



Wc now use the identity zQ ~ n ^QYY 



E 

















n 


pi 



Sip - i) 



I, which results in 

-5{p -£)£[<!>], 

2nd and 3rd terms of next to last equation 



—2(1 + a) 2(1 + a) 

Multiplying each side by [M*]p[ij]f and taking the sum over p and i, we finally obtain 
u*v 



E[u*Qv(j)] = E[0]- 



-z(l + a) 



-2(1 + a)]-'^E 



YD{I + aD)-^ ■ 
pu Q V 



I 



+ -[-z{l + a)]-^E 
n 



' *^ ,x ,,YD{I + aDY^Y* ' 
u*QsLd]{'ip)->p' ^ V 



(10) 



Let us evaluate the three terms at the right hand side of this equality. From 
Lemma 14. 5[ we have a = Cnrrin + 0{n~^). Using in addition the bound ([9]), we 
obtain a = Tr(i:>(-2(/ + c„?7i„D + (a - c„to„)-D)"^) = Tr DT + 0{n-'^). 
Since m„(2) ~ (— 2(l+n^^ TrDT(2)))~^, we obtain that (—2(1 + a))~^ — mn{z) + 
C(n~^). Using in addition Lemma l4^ we obtain that the first right hand side term 
of pn)) is u*vmn{z) + 0{n~^). Due to the presence of (j) in the expression of /3, 
the second term is bounded by ii:E|/3| . Moreover, /3 = 71" V Tr Q - n"iE[0 Tr Q] + 
(1 - (/i)n-iE[0TrO]. By Lemmas El] and ESI E|/3| 0{n-^). The third term can 
be shown to be bounded by Ktl^^ETy ipiji^^YY*) = 0{n~^) where is as in the 
statement of Lemma 14.11 This proves the first inequality in the statement of the 
lemma. 

The second result in the statement of the lemma is proven similarly. The proof 
requires the second inequality of Lemma 14.51 □ 



The proof of the following lemma can be done along the same lines and will be 
omitted: 

Lemma 4.7. The following inequalities hold true: 

E(j)nU*J^nQn{z)Vn < K j \fn 



E 



< K. 



We now prove Theorem 12.2 



Proof of Theorem l2.2l -(fT|). To prove this result, we follow the idea of [51 [S]. We 

start with a purely algebraic result. By Assumption |4l there exists a. N x r matrix 
An and a n x r matrix Bn, both with rank r and bounded spectral norms, such 
that Pn = AnB'^ (at this step, An need not be an isometry matrix as was done 
before Equation ([6])). Assume that a; > is not an eigenvalue oi n^^YnY* . Then 
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X is an eigenvalue of SnS* if and only if det Sn{x) = where Sn{x) is the 2r x 2r 
matrix 

V^A*^Qnix)A„ Ir+n-^/'^A*JnQn{x)Bn 

"^""^ [/. + n-i/2s*Q„(a;)r„M„ ^B*Qn{x)Bn 

(for details, see the derivations in [3] or in [501 Section 3]). The intuitive idea is the 
following. Fix the value of x. By the results shown above, S„ {x) is close for large 
n to 

"^""^ " [ ^/^i?;f„(x)i?„ • 

Hence, we expect the eigenvalues of Sn^* in (a, &), when they exist, to be close for 
large n to the zeros in (a, b) of 

detS'„(a;) = det {xmn{x)A*„AnB^fn{x)Bn - 

= (-l)'-dct (In - xm„{x)PMx)P:^ . 

For any x € (a,6), det5„(a;) = dct(i7„(a;) + ~ (-1)'' det(i7*(a;) + Ir) 

where is given by Equation ([7]) and iJ* is provided in the statement of the 
theorem. Hence the zeros of I?(a;) in (a, b) are the limits of the isolated eigenvalues 
of S„S;. 

We now formalize this argument. Our first task is to establish the properties of 
H^{x) given in the statement of Theorcm l2.2l -P]). We start by defining the function 
dot Sn{z) on C+ by writing 

det 5„(z) = (-1)'- dot (In - zm„{z)PMz)P*^ = {-If dot (iJ„(z) + /,) . 

Let 1^ be a small enough neighborhood of [xi, 2:2] in C, where we recall that [xi, 2:2] 
is an arbitrary interval in (a, &). By the construction of A„, Proposition 12.11 and 
Lemma |3. 11 the functions Hn{z) are analytic on V for n large enough, the functions 
H^_{z) are analytic on V , and from every sequence of integers increasing to infinity, 
one can extract a subsequence ^p{n) along which i/y(„) (z) converges to one of the 
Ht{z) uniformly on the compact subsets of V . The comments preceding Theorem 
12.21 show that any H^{z) is the Stieltjes Transform of a matrix- valued nonnegative 
measure F. Since H^,{z) is analytic on V, the interval [a;i,X2] lies outside the 
support of F. Hence, the extension of Ht,{z) to [xi, X2\ is increasing on this interval 
in the order of Hermitian matrices, and the properties of this function given in the 
statement of Theorem 12. 21 - are established. 

In order to prove the convergence stated in Theorem 12 . 21 - p]) . it will be enough 
to show that for large n and with probability one, EE* has no eigenvalues in any 
compact interval lying in {a, pi)^{pi, P2), . ■ ■ , or in {pk,b) if fc > 1, or in (a, &) 
if fc — 0, and the number of its eigenvalues in any small neighborhood of any 
of the Pi is equal to the multiplicity of this zero. Let be the open disk 

with diameter [xi,a;2] where xi and X2 are chosen such that [xi,a;2] C (a, &) and 
n {xitX2] = 0. Let us restrict ourselves to the probability one set 
where n~^YY* has no eigenvalues for large n in a large enough closed interval in 
(a, b). We need to prove that on this set, the number of zeros of det 5'„(z) in D°^ ,^^ 
converges almost surely to the number of zeros of dct(iJ*(z) + 1^) in that same 
disk. Let i„ = : A" G Dl_^ ,^^}, i„ = jl{ zeros of det S'„(z) in -D°^ ^.^j, and 
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L ~ : Pi G ^2 with multipUcities}. By the well known argument principle 
for liolomorphic functions, 



dD°..o detS'„(z) 



1 / (dct5„(.)y^^^^^ (det(g„(.) + /.)y^^ 



2nr Jgjjo ^ detS'„(z) 2i7r /g^o^^ det(i?„(z) + 7^) 



"^IT^ JdD° dct(iJ,(z) + /r) 

^ 1 

where is seen as a positively oriented contour. 

For any 1 < A;,^ < r, let hn,k,i{z) = [A,*((3„(z) - m„(z)/Ar)A„]fe,£. Let V 
be a small neighborhood of D^^ ,^^^ the closure of . Let z„j be a sequence of 

complex numbers in V having an accumulation point in V . By Lemmas 14 . 1 [ 14 . 3] and 
14.61 and the Borel Cantelli lemma, hn^k,e{zm) as n — > oo for every m. Moreover, 
for n large, the hn^k,e are uniformly bounded on any compact subset of V. By the 
normal family theorem, every n-sequcncc of h„^k,e contains a further subsequence 
which converges uniformly on the compact subsets of to a holomorphic function 
/i*. Since h^,{zm) = for every m, we obtain that almost surely, hn.k.e converges 
uniformly to zero on the compact subsets of V, and the same can be said about 
~ '7i„(z)/7v)^n||- Usiug in addition Lemmas 13.11 and 14 . 71 we obtain the 
same result for ||B;(Q„(z) - r„(z))B„|| and n-i/2p;y„Q„(z)B„|| . 

Since det X is a polynomial in the elements of matrix X , det Sn{z) — det Sn{z) 
converges almost surely to zero on dD°_^ and this convergence is uniform. By 
analyticity, the same can be said about the derivatives of these quantities. More- 
over, detS'„(2;) converges to {—ly dct{H^,{z) + U) (which is the same for all ac- 
cumulation points A*) uniformly on dD°^^ . Similarly, (detS'„(z))' converges to 
(— l)''(det(7J*(z) + /,■))' uniformly on 913°^ ^j.^- Furthermore, by construction of 
the interval [xi, X2\, we have mizedD° I dct(i/*(z) -I- 7^)1 > which implies that 

^ 1 1 ^2 

liminfn inf^gODo^ |detS'„(z)| > 0. It follows that L„ — L„ — >■ and L„ — > L as 
n ^ oo. This concludes the proof of Theorem 12 . 2K fT|) . 

Proof of Theorem I2.2I -(P|1 and ([3]). We start with the following lemma: 

Lemma 4.8. Let A = inf (supp(/.i) — {0}). Let L = [2;i,a;2] C supp(/i)^. Then the 
following hold true: 

(i) If X2 < A, then m(j:)(l + cm{x)t)^^ > for all x E I and all t e supp(j/). 

(ii) Alternatively, if xi > A, then there exists a measurable set E C K-|_ such 
that v{dE) = 0, v{E) > and m(a;)(l -I- cxn{x)t)~'^ < for all x e I and 
all t e E. 

Proof. To have an illustration of some of the proof arguments, the reader might 
refer to Figures [1] and [2] which provide typical plots of a::(m) for c < 1 and c > 1 
respectively. We start with a preliminary result: 

Since m(z) is the Stieltjes Transform of a probability measure supported by M+, the 
function m(a;) decreases to zero as a; — > — oo. From Proposition 13.21 x{m.) — > —oo 
as m — >• 0+ , and 

m > x-(m) < A. 
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From Proposition l3.2l J = m(/) is an interval [mi, 1112] C B. Let E = [0, — (cmi)~^] 
with the convention E ^ % when mi > 0. We aheady assumed that J^({0}) = 0. 
Since — (cmi)~^ G supp(j/)^ by Proposition 13. 2[ (cmi)"^}) 0. The main 
part of the proof consists in showing that 



To see why pT|) proves the lemma, consider first xi > A. Then mi < and m2 < 0. 
For any t E E and any m G J, 1 + cmt > 1 — cm(cmi)^^ > 0. As m < 0, (m) is 
true. Assume now that X2 < A. In the case J C (0, 00), (z) is immediate. Assume 
J C Bn (—00,0). Then, since v{E) = 0, we get that Vi G supp(i^),t > — (cmi)^^, 
therefore t > — (cm2)~^. Consequently, for any t G supp(i/) and any m G J, 
1 + cmt < 1 — cm(cm2)^^ = 1 — m/m2 < 0, and (i) is true. 

Let us first prove (fTT|) in the <^ direction. When xi > A, we have seen that 
mi < 0. Assume that i^{E) = 0. Then (— cx),mi] C B. Since t > — (cmi)^^ in the 
integral in ([5]), x{m) -> as m — > —00 by the dominated convergence theorem. By 
Propositions 13 . 1 [ 13.21 and | 3 . 3[ x{m) should be increasing from to Xi on (—00, mi]. 
This contradicts Xi > A. 

We now prove in the direction. To that end, we consider in turn the cases 
c < 1 , c > 1 and c = 1 . 

Assume c < 1. We have seen that a;(m) —00 as m ^ 0+. From ([8]) we 
notice that ma;(m) (1 — c)/c > as m — > 00, hence x(m) reaches a positive 
maximum on (0, 00). By Propositions 13.2] and 13.3] this maximum is A, and we have 
X < A^ m{x) > 0. Therefore, xi < A^ v{E) = 0. 

Consider now the case c > 1. We shall also show that xi < A ^ ^{E) = 0. By 
Proposition l3.41 the measure has a Dirac at zero with weight 1 — c^^. Hence, either 
xi < a;2 < 0; or A > and < xi < 2:2 < ^. Since m(z) is the Stieltjes Transform 
of a probability measure supported by M+, it holds that x < m(x) > 0. Hence, 
v{E) — when xi < 0. We now consider the second case. Since (0,xi] C supp(/i)'^, 
the image of this interval by m belongs to B. By Proposition limj,^o+ ni(a:) = 
—00. Hence this image is (— oo,.ti]. This implies that v^E) = 0. 
We finally consider the case c = 1. We show here that A ~ 0, which will result in 
.T < A => m(.T) > i^{E) = as above. Assume A > and let xq G (0, A). By 
Proposition [321 /^({O}) = hence m(a;o) = J{t~ xoy^fi{dt) > 0. But from ([U, 
we observe that x(m) increases from —00 to as m increases from to 00, which 
raises a contradiction. This concludes the proof of Lemma 14.81 □ 

This lemma shows that for any x < inf(supp(/i) — {0}), H^{x) > 0, hence 
Vix) > for those x. This proves Theorem [2^ (|?|). 

Turning to Theorem 12.21 - ([3]) . choose an interval [.Ti,a:2] C (a, 6) such that [pi,pr] C 
(xi,X2). Let E be the set associated with [a;i,a;2] by Lemma l4.8l -(ii). By Lemma 
14.81 -fii) and the properties of a Stieltjes Transform, the function 



is negative and increasing on [a;i,X2]. Let ft = diag(ci;J, . . . , o;^) where = 
— l/q{pk)- Then it is clear that function ~ dct{q{x)n + Ir) has r roots 

in [a;i,X2] which coincide with the pk- Theorem 12.21 - ([5)1 will be proved if we find 
a sequence of matrices P„ such that one of the Hn{z) associated to P„ as in ([7]) 
converges to q{z)^ uniformly in the compact subsets of a neighborhood of [cci, X2]. 



v{E) >Q^xi> A. 



(11) 
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Figure 1. Plot of x(m) for c = 0.1 and = 0.5(5i + ^3). The 
thick segment represents supp(/i). 





\ 
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Figure 2. Plot of a;(m) for c = 5 and = 0.5((5i/2 + ^5/2)- The 
thick segments represent supp(/i). 



Rearrange the elements of _D„ in such a way that all the d" which belong to E are in 
the top left corner of this matrix. Let M„ — [M"^] be a random [nz^(£')J x r matrix 
with iid elements such that y^A/"j has mean zero and variance one. Let Zn be the 
nx r matrix obtained by adding \ ni'{E)\ rows of zeros below M„. Then the law 
of large numbers shows in conjunction with a normal family theorem argument that 
there is a set of probability one over which zm„(z)Z*T„(z)Z„ converges to q{z)Ir 
uniformly on the compact subsets of a neighborhood of [cci , ^2] ■ Consequently, there 
exists a sequence of deterministic matrices Bn such that zmn{z)B*Tn{z)Bn — > 
q{z)Ir uniformly on these compact subsets. Matrix P„ = AnB'^ with An = 

' 1 . . 

satisfies the required property. Theorem 12.21 - (|3|) is proved. 

y{N-r)xr\ 
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5. Second Order Analysis 

In all this section we shall work on a sequence of factorizations P„ ~ UnRn such 
that A„ satisfies the third item of Assumption[71 We also write Un = [C^i,n • • ■ t^t.n] 
and Rn ^ [Ri.n ■ ■ ■ Rt,n] where C/i,„ € C^^J' and i?i,„ G C"^^'. 



We start by briefly showing the first two facts stated by Theorem 12.31 For any 
i = 1, . . . ,p, it is clear that m.{pi)^ > and m'{pi) > 0. An immediate calculus 
then gives m'(pi)A(pi) = m^(pi) which shows that A.{pi) > 0. 
To prove the second fact , we shall establish more generally that lim sup ^/n 1 1 Hn {pi) + 
g{pi)ft\\ < oo. Invoking Equation ([3]) and its analogue mn{z) = {—z + / i(l + 
Cn'm'n{z)t)^^Vn{dt))~^ , taking the difference and doing some straightforward deriva- 
tions, we get that {mn{pi) — m{pi)){A{pi)+ei) = 62 where ei — > and where \e2\ < 
K/y/n thanks to the first two items of Assumption [T] Hence |m„(pi) — m{pi)\ < 
Kj ^n. Now we have 



H.n {p^) ^ g{p,)n = J 



m„{pi) m(pi) 



Cnmn{pi)t l + cm{pi)t 



K{dt) 



"^''^ -Mdt)- [ -^^^Adt)^n. 



1 + cm.{pi)t J 1 + cni{p.i)t 

which shows thanks to Assumption [7] that limsup ■\/n||i7„(pi) + g{pi)n\\ < 00. 



We now enter the core of the proof Theorem 12.31 The following preliminary 
lemmas are proven in the appendix: 

Lemma 5.1. Let s be a fixed integer, and let Zn = [Zij] be a N x s complex 
matrix with iid elements with independent Af(0, 1/2) real and imaginary parts. Let 
Tn = [^ij] be a deterministic Hermitian N x N matrix such that TrTAr = 0, and 
let Fn = [Fij] be a complex deterministic N xs matrix. Assume that F^F]\j — > <i^Is , 
that limsup^ l|T"-/v|! < 00, and that TrT^ cr^ as N ^ 00. Let AI be a s x s 
complex matrix with iid elements with independent Af {0,1/ 2) real and imaginary 
parts, and let G be a s x s GUE matrix independent of M . Then 

N~^/''Z*^TnZn,Z*^Fn) {ctG,<;M). 
Lemma 5.2. For x G supp(^)'^; 

-I 1 - c„x^m„(a;)^- TrZ;^T^(x) 
and 

K 



Var (^cj)nUnQn[x){n ^Y*Yn)Qn{x)Un 



< 

n 



Lemma 5.3. For i ~ 1, . . . ,p, let Ai be a deterministic Hermitian ji x ji matrix 
independent of n, where p and the ji are as in the statement of Theorem \2.3l For 
i = 1, . . . ,p, let n o, n X ji matrix such that sup„ ||Mj_„|| < oo. Then for any 



E 



cxp(iV^i^TrA,A/*„(Q„(pO-T«(Pz))M^,„)l = cM-t^^l/^)+Oin-^/^) 
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where 

p 

= ^ CnPiPkmn{pi)mn{pk) 
i,k=l 

Ty A,M*Mp^)Dnfn{pk)Mk.,nAkM* „fn{pk)Dr^fn{p^)M,^r^ 
X ■ '— — . 

1 - CnPiPkmn{pi)mn{pk)^^YDnTn[pi)DnTn[pk) 

Replacing the Mi_„ with the blocks Ri^n of Rn in the statement of Lemma 
and observing that 

Rnfn{pi)Dnfn{pk)Rn = / ZT" , ^w-, , 1 r— A„(di), 

J PtPk(i + Cnmn{pi)t)(l + Cnmnipkjt) 

we obtain from the third item of Assumption [7] that af^ — > X^iLi '^^^f where 
Invoking the Cramer- Wold device, this means that the p-uple of random matrices 

{RlniQn{p^) ~ TM)R.,n)[^^ 

converges in distribution towards {o'lGi)^^-^ where Gi, . . . , Gp are independent GUE 
matrices with Gi E C^»^^'. 

Lemmas I5.1H5.3I lead to the following result which plays a central role in the 
proof of Theorem [ 



Lemma 5.4. Consider the 3p-uple of random matrices 

/c/*„y„g„(p,)i?„i ~ ~ ^ 

Define the following quantities 

2 ^ ^ f _J^^^k}}^^idt) 
2_ 1 f ^\P^)t^ 



'^^ - A{p,)J {l + cm{p,)tr''^'^*^ 



Let All, ■ ■ ■ , Mp be random matrices such that Mi e C^' and has independent ele- 
ments with independent M {0, 1/2) real and imaginary parts. Let Gi,Gi, . . . , Gp, Gp 
be GUE matrices such that Gi,Gi e C-''^-''. Assume in addition that Mi, Gi, Gi, 
. . ., Mp, Gp, Gp are independent. Then 

Ln — > (^iMi,criGi,d-iG, 



va.{pi)t 
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Proof. Let an{p) ~ N^^TvQnip)- By Lemnias l4.3l and l4.5[ ^/n(a„ ipA—m^ (pA) ^ 
0. Therefore, we can replace the mn{pi) in the expression of L„ by an{pi), as we 
shaU do in the rest of the proof. 

Write s = ji + ■ ■ ■ + jp and let Z„ be a iV x s complex matrix with iid elements 
with independent A'^(0, 1/2) real and imaginary parts. Assume that Z„ and Xn 
are independent. Write Zn = [Zi,n ■ ■ ■ ^p,n] where the block is iV x ji. Let 
n~^/^X„ = W„A„W^ be a singular value decomposition of n~^/^X„. By assump- 
tion [2l the square matrices Wn and Wn are Haar distributed over their respective 
unitary groups, and moreover, Wn, A„ and Wn are independent. Let 



Ln — 

f/,:(Q„(ft) - a„(p,)/^)C/„, R*JQn{p^) - fM)R^,}j ■ 

We have 

I„^(Viv(z*z„)-i/2^*^^,,„,ivi/2(z:z„)-i/2z:T,,„z„(z;z„)-i/2^ 

VnRlniQniPi) - Tn{pi))Ri,n 

/ z— 1 



where F,,n = Cn^'^ /^nW*D]J^Qn{p^)R^,n and T,,„ = c„ '/'((A„iy* AiVt^«A„ - 
Pi)^^ — an{pi)lN)- We shall now show that the term \/N{Z*Zn)^^^^Z*Fi,n can 
be replaced with Z*Fi^n- By the law of large numbers, we have N-'^Z*Zn ^ L- 
By the independence of Zn and (A„, W„), we have E[Tr Z*Fi^nF*^Zn \ {AnWn)] = 

sc~^ Tr R* ^Qn{pi){n~^Y*Yn)Qn{pi)Ri,n whose limit superior is bounded with prob- 
ability one. Hence Z*Fi.„ is tight, proving that the replacement can be done. 
By deriving the variances of the elements of N~^^'^Z*Ti^nZn with respect to the 
law of Zm and by recalling that limsup„ ||Ti^„|| is bounded with probability one, 
we obtain that these elements are also tight. It results that we can replace L„ with 



Z* ^ Z ~ ~ ^ ^ 

Z*,,Fi^n, ^ '^" ,^/r^i?*„(Q„(pi) - r„(p,;))i?j,„ 

/ 1=1 



For i = 1, ... ,p, let Ai and Bi be deterministic Hermitian ji x ji matrices and let 
Ci be deterministic complex ji x ji matrices, all independent of n. The lemma will 
be established if we prove that 



E I exp(^^/;^^ ^ Tr A,i?*„(Q„(p,) - Tn{pi))R^,n 

I i=l 

P 

xE' 

P 



[exp(zt ^ TrS,Z*„T,,„Z,,„ + 5R(Tr aZ*„F,,„)) | (A„, W„) 

f[ exp(-<2(^2 ^2 ^ ^2 52 ^ 1 ^2 c.C;)/2). 



(12) 



'i=i 
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In addition to the boundedness of ||Ti,„|| w.p. one, we have TrTi_„ = 0, and 



1 1 ^ 



Moreover, using Lemma 15.21 in conjunction with Assumption [51 we obtain 



From any sequence of integers increasing to infinity, there exists a subsequence 
along which this convergence in probabihty holds in the almost sure sense. Ap- 
plying Lemma rs. 11 we get that the inner expectation at the left hand side of 
converges almost surely along this subsequence towards nr=i exp(— t^(cr^ Tri?^^ ' 



i^f Tr CiC*)/2). Using in addition Lemma [5.31 along with the dominated conver- 
gence theorem, we obtain that Convergence (|12p holds true along this subsequence. 
Since the original sequence is arbitrary, we obtain the required result. □ 

The remainder of the proof of Theorem 12.31 is an adaptation of the approach of 

m- 

Lemma 5.5. For a given a; G M and a given i G {1, . . . ,p}, let y — Pi + nT^I'^x, 
and let 



Sn{y) = 

Let 



X det 



23? 



detSniy)-l[Hg{p.)~iy 

\/nU*„ {Qnifi) - mn{pi)lN) Ui^n 



+ Pini{pi)y/n.R* ^{Qn{pi) - Tn{pi))Ri 



U*nYnQnip^)Run - V^{H,,n{pi) + /jj - xH[n{p,) 



(13) 



where 3?(M) = (M -I- M*)/2 for a square matrix M . Then 



for every finite sequence {xi, . . . , Xp\. 

Proof. Wc show the result for i ~ 1, the same procedure being valid for the other 
values of i. The notation Xn = op{l) means that the random variable Xn converges 
to zero in probability, while Xn = Op{n~^) means that n^Xn is tight. Write 
U = [Ui,Ui] and R = [Ri,Ri] where Oi ^ [C/2 , . . . , f/*] and Ri ^ [R2,...,Rt]. 
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Writing 
A 



B = 



'lj,+n~^/^U;YQ{y)Ri 





'All 


Al2 




A* 


A22_ 



Ir-ji 



n~^/^UlYQ{y)Ri 
■ n-^/miYQ{y)Ri 



Bii Bi2 
B21 B22 



and 



C 

we have 



^RlQ{y)Ri ^RtQ{y)Ri 
^RlQ{y)Ri ^R*My)Ri 



Cii C12 
CI2 C22 



det S = det 



A B 
B* C 



det 



All 


Bii 


A12 


B12 








Bli 


Cii 


B21 


C12 


■= det 


'Mil 


M12 


A* 
^12 


B21 


A22 


B22 


M*i2 


M22_ 


^12 


'^12 


B22 


C22_ 









after a row and column permutation. Hence n-'^/^ det S = det M22 x n^^/'^ det(A'/ii — 
M12M22 Ml2)- Write O = diag(ajj/jj , ^2). From the first order analysis we get that 



M22 > 



pim{pi)lr-j. 



which is invertible since det Af22 ^ Ukyii'^biPi) - ^V" + 0- Moreover, \\Mi2\\ = 



Op(n ^1"^). To sec this, consider for instance the term y/nCn = ,JnyK{{Q — 
T)Ri + y^nyRlTRi. The first term is tight by Lemma 15.41 while the second is 
bounded by Assumption [71 The other terms arc treated similarly. It results that 
\\Mi2M22'M^2\\=Op{l/n). 

In addition, dct{y~^^'^Cii) ^ [ujf{cm{pi) - p^^{l - c))y^ = {pim{pi))-^^ by the 
definition of pi . From these observations we get that 

n^'^/2det5= (^lliuMpi) ~ 1)^^ +op(l)^ ((pim(pi))--''^ +op(l)) 

X det (y^Aii - ^BiiC^^Bl^ + Op(n-i/2; 



Now we make the expansion 

^Aii ~ ^BiiCl^Bl^ (14) 
= y^fnU{{Q{y) - m„(y)/Ar)C/i + y^/nmn{y)Ij^ 

+ (^In + [/r^^i?!^ {RlQ{y)Ri)-'{Rl{Q{y) - f{y))Ri){Rlf{y)Ri)-' 
x(ln^Rl^Ui] 



^Ji^^+U*I^rA {RlT{y)Ri)-^ U + Rl9^^Ui 



(15) 
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To go further, remark that 



{RlT{y)Ri)-^ {ymn{y)RlT{y)Ri - pimn{pi)RlT{pi)R, 



+^/n [pimn{pi)RlT{pi)Ri - Ij^ 
= pim(pi) [~xH[{pi) - VT^{Hi{pi) + /jj] + o(l) 

where we recall that y = pi + xn^^ pi and that R\T{y)Ri {pim.{pi))^^ Ij-^. 
RecaU from Lemma EH that y/liU^{Q - mnI)Ui, y/^Rl{Q - and U^YQRi 

are tight. Keeping the non negligible terms, we can write (|14p under the form 

VnyAii ~ y/nyBiiC^^Bl^ 

= piV^U^iQipi) - m„(pi)/jv)[/i + (pim(pi))2V^i?t(Q(pi) - f 

- 2pim(pi)3? [c/*rQ(pi)i?i] - pim(pi) {xH[{p,) + + + op(l). 

Plugging this expression at the right hand side of the expression of n^^^^ det S and 
observing that H{ „(pi) ~ujfg{piy Ij^ concludes the proof. □ 

For i = take xi{i) > yi(i) > X2(i) > y2{i) > ... > yji{i) fixed se- 

quences of real numbers. Call J„ = — pi), i = 1, . . . ,p, £ ~ 1, . . . , ji), 



with k{i) = ^In^ijm- Let also C be the rectangle C = [a;i(l), yi(l)] 
[xpUp)jypijp)]- Then, for all large n, with probability one 



X . . . X 



Xi{i) 



[Jn G C) = P det 5„ + ^ det 5„ \p, + ^\<Q 



since detS'„(i) changes sign around t = A^'j-^-j^^^, and only there (with probability 
one, for all large n). 

From Lemma 15.51 we see that, for growing n, the probability for the product of 
the determinants above to be negative for all i and £ approaches the probability 

P({dctyl^^(,;)detyl2^,(,) < 0, i = i = 

where is the matrix 

VnU*^^ {Qn{pi) - mn{Pi)lN) Ui^n Pi^/nR*^^-XQn{Pi) - Tn{Pi))Ri,n 



Ax — 



23? 



m(pj) (c + cp;xa{pi) - 1) 



This last probability is equal to P( G C), where J„ are the decreasingly ordered 
eigenvalues of the matrix 



= [HIM] 



^ / y/nU*n {Qn{Pi) - m„ {pi)lN) Ui^n 



m(pi) 



p,^R*JQn{p^)-Tn{p^))R^,n 

ujf{c + cp,in{pi) - 1) 



23? 



UlnYQn{Pi)Rr.n ~ V^{H„,{p,) + /jj 
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From Lemma 15.41 . . . , Bt} asymptotically behave as scaled non-zero mean 
GUE matrices. Precisely, denoting Bi = H[.,-^{pi)Bi + \/n{Hi^n{pi) + Iji), from 
Lemma 15.41 and for all a, b, 



E KB, 



2 



2-2 



m(pj)2 ujf{c + cp,m{pi) - 1)2 
t^v{dt) 



2^ 



m{piY 



(l + cm(p,)i)' 



2 4 



m.{pi)tv{dt) 
(1 + cm.{pi)tf 



2ujftv{dt) 
(1 + cm(p,)i)' 



This concludes the proof of Theorem 



Appendix A. Proofs of Lemmas 15.11 to 15.31 

A.l. Proof of Lemma I5.1[ Given a s x s deterministic Hermitian matrix A 
and a s X s deterministic complex matrix B, let Fjv = N~^^'^Tt AZ'^T is[Zis[ + 
3fi(TrBZ^F/v) where 3?(M) = (A/ + M*)/2 for any square matrix M. We shah 
show that for any i S M, 

:= E[exp(itrw)] ^cxp -t^ ^ cxp — 

The result will follow by invoking the Cramer- Wold device. To establish this 
convergence, we show that the derivative ^'^^ify satisfies f'j^it) = —tv'^(pN{t) + 
£N(t) where ejv(i) — ^ as — > oo uniformly on any compact interval of M. 
That being true, the function ^pN{t) = (pN{t) exp{t^v^ /2) satisfies ipNit) = 1 + 
/q eN{u) exp{u^v^ /2)du 1 which proves the lemma. 
By the IP formula, we get 

if'{t) = iE[r exp{itr)] 



'N 

i,j=lk,i=l ^ ij = lk=l 



X exp{itr) 



. A,Tkid{Ze,cxp(itT)) 



We obtain after a small calculation 



1 ^ aexp(»tr) dexpjttr) 
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which leads to 

ip'{t) = -tE[N-^ Tr A^Z*T^Z cxp{itT)] - {t/2) Tt:{BB*F*F) ip{t) 

- tElN"^/^ Tt AB* F*TZ exp(iir)] - {t/2)E[N-^/^ Tr Z*TFBA exp{itT)]. 

Let us consider the first term at the right hand side of this equation. We have 
E[N~'^ Tr Z*T'^ Z] = N-^ Tr TrT'^ . Applying the Poincare-Nash inequality, 
we obtain after some calculations that Var(iV-i Tr A'^Z*T'^Z) < 2N-^ Tr A'^ Tr T"^ = 
O(iV-i) since ||T|| is bounded. It results that E[N~^ Tr Z*T^ Z exp{ttT)] = 
iV-i TrA^ TrT^ ip{t) + 0{N-'^/'^) by Cauchy-Schwarz inequality. The third term 
is zero by hypothesis. Finally, N-'^E\Tr Z*TFBA\^ = N-^TrT^FBA^B*F* < 
N-^\\T\\^TrFBA^B*F* = 0{N-^). Hence, the last two terms are 0{N-^/^) by 
Cauchy-Schwarz inequality, which proves Lemma |5. II 



A. 2. An intermediate result. The following lemma will be needed in the proof 
of Lemma 15.21 



Lemma A.l. For x,y € supp(/i)'^ 
1 



E 



E 



■Tr Q^{x)DQ^{y)D 



4'nU*nQnix)DQn{y)v„ 



^Tr DTn{x)DTn{y) 



1 - c„a;TO„(x)ym„(?/)i Tr DTn{x)DTn{y) 



ulTn{x)DTn{y)v„ 



1 - Cnxmn{x)ymn{y)^ Tr DTn{x)DT„{y) 



+ 0(n-i) 



+ 0(n-i). 



Proof. We denote here = Q{x) and drop all unnecessary indices. Using the 
integration by parts formula, we obtain 



Ie 

n 

-Ie 

n 



6ia - j)E 



Qy 



lx,jp^y,pq 



4'Qx,jj [YQx]ipY^i^Qy..^ 



-E 



xJpQy,pj 



-E 



xJpQy, 



pq 



Summing over i, p, and j, this is 



n 

-Ie 

n 



<f>[Y*YQ.,DQy]aq 



1 



tE 



[Y*eidi{i,)^'YDQ,DQy]aq 



xDQy] 

aq 



h-Tr DQ^[Y*YQ,DQy]aq 



-Ie 

n 



^-Tr Q,DQyD[Y*YQy]aq 



Using the relation ^Y*YQri. ~ xQx + In a-nd appropriately gathering the terms 
on each side gives 



E 



xF)Qy\(in{x Cji (Iq^ ~\- X Tr F)C^ 
n 



-E 



E 



(f)[DQy\aq{l + -Tr DQ,) 



:[Y* &d]{ij),k'YDQ^DQy\aq 



E 



6- Tr Q^DQyD{5{a - q) + y[Qy]aq) 



(16) 
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Introducing the term ji^ = 0^ TrDQ^ and — $x — <t>^[Px], we have 



E 



4>[QxDQy\aq [x — da 



-E 



ck[DQy\aq (l + E[/?,])-E 



1 



■ Tr QxDQyD 



{S{a-q)+yE[[QyUg]) 



E 



[Qx^Qy] aq^^x 



-E 



0- TrQxDQyDy{[Qy]ag - E[Qj,],,] 



-E 



— [y*adj(V')V''>^-DQ,DQj,],, 



(17) 



At this point, wc can prove both results for the trace and for the quadratic form. 
We start by dividing each side by a; — c„ da + xE[/3^]. We begin with the trace 
result. Multiplying the resulting left- and right-hand sides by da, summing over 
a = q and normalizing by l/n, we obtain 



E 



'-Ti-QxDQxD 
n 



= -(1 + E[/3,])E 



Tr DQyDAx 

n 



-E 



<-i:YQxDQyD 



yE[c^- TvDAxQy] + - TrDAx 
n n 



where we denoted Ax = {x{\ + E[/3a;])/„ — CnD) ^ and where 

1 



■E 



TiDQyDAxPx 



1 



TrQxDQyDAxPx 



1 



1 



Tr QxDQyDy - Tr QyDAx - E(- Tr QyDAx 



(18) 



From Lemma E[Px] 
is easily observed that 



0(n~2), where we denoted 4 = ^ Tr DT^. Also, it 
1 



/„(1 + 5x)x - CnD 



1 + Sx 



-^Tx 



(19) 



with Tx — T{x). Therefore, along with Lemma |4.5[ we now have 
1 



E 



■TrQxDQxD 



-TrDTxDTy+E 



h-TvQxDQxD 
n 



y}^Tr DTxTy + ^Tr DTx 
1 + 4 



+ £„ + 0(7i-2). 



Using now the fact that yTy + /„ 



1 



-Tr QxDQxD 
n 



Cri — ^^DT,,, we conclude 
^^TrDTxDTy 



, ^+£„ + 0(7i-2). 

1 - c„(l + 4)-i(l + 5y)-^lTrDTxDTy 

It therefore remains to prove that e„ ^ ©(n^^). Due to the presence of in the 

expression of j3x, and using Lemma 14.31 and Cauchy-Schwarz inequality, one can see 
that the last three terms in the expression of are 0(n~^). As for the first term, 
it is treated in a similar manner as in the proof of Lemma [4.61 and is 0{n^^). 
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In order to prove the result on the quadratic form, we start again from (|17p . 
Dividing each side again by x — c„ da + xK[f3x], introducing [u]a, [v]q, and summing 
over the indices, we obtain 



E 



t>U*Qa:DQyV 



-E 



hu* AxDQyV 



-E 



1 



TrQ.DQyD 



{u*A,{yE[(j)Qy] + + 4 (20) 



where e'^ is very similar to e„ and is shown to be ©(n ^) with the same line of 
arguments. Using Lemma l473l ^T9\\ . and the previous result on E[</)i Ti Q^DQyD], 
we finally obtain 



E 



bu*QxDQyV 



= u*TxDTyi 
from which 



E 



tiu*QxDQyV 



Cn{l + 5x)-H^+~5v)-^ll'^^DTxDTy 
1 - c„(l + + Sy)-^^TrDfxDfy^ 

u*TxDTyV 



1 - c„(l + 4)-^! + 5y)-^}-TvDTxDTy 
We conclude with the remark xmn(x) = —(1 + d^)^^ . 



+ 0(n-i). 



□ 



A. 3. Proof of Lemma l5.2l The line of proof closely follows the proof of Lcmma lA.ll 

We provide here its main steps. By the integration by parts formula, we have 

^[4>QpkYilYimQmr] = ^ ^^[4'QpkYf*kQmm[Y Q]er] + S{k - m)dmE[4>QpkQm.r] 
-^n<PY,lQ^rQpm[YQ]ik] 
+ ^nQpkY;kQmr[s^di{^)^'Y]i^] 



Taking the sum over m, we obtain 



n<l}QpkY,l[YQ]er] 



1 + E[ 



~-E[<j)QpkQkr] 



1 1 



1 + Ef3n 



e[^y;,[qdq]j,4yq] 



£k\ 



1 1 



1 + E[^] 



E[QpkY,l[admi''YDQ]fr] - E[/3Qpfey/jyQ]fr] 



where /3{x) = 0^ Tr DQ{x) and f3{x) = /3(a;)— (/)E[/3(a;)] as in the proofofLemma lA.il 
Taking the sum over £ then over k, we obtain 

1 



^E[(l)[QDQ]pr] - 



^-^E[cl,[QDQ]pr- Tr(^g)] 
1 + E\B] n n 



1 + E[/3] n n n 

Observing that (1 + E[(3{x)])^^ = —xmn{x) + 0{n^^) and making the usual ap- 
proximations, we get 



E[(j)i 



*Q^^Qu] ^ ( xm,,{x)- Tr(E[0^^Q]) - CnXm„{x))E[(j)u*QDQu] + 0{n-^) 
n \ n n J 
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Observing that n,-^ TT{E[(t){n-^Y*Y)Q{x)] ^ Nn-^xninix) + Nn,-^ + 0{n-^) and 
invoking Lemma I A. H we obtain the desired result. 



A. 4. Proof of Lemma 15. 3i As in the previous proofs, we discard unnecessary 
indices. We also denote Qi = Q{pi)- For readability, we also write A-'U = Mi,nAi 
and use the shortcut notation F = y^^^^j^ Tr Af*QiMi. We focus first on the 
term in pi . The line of proof closely follows that of Lemma 15.11 with the exception 
that we need to introduce the regularization function (f> to ensure the existence of 
all the quantities under study. That is, with (pN{t) = E[exp(«i0r)], we only need 
to show that '^'^{t) = —ta'^ipN{t) + 0{l/^/n). Using |(^Ar(i)| < 1 and Lemma [44l 
|E[exp(ztF)] — ipN{t)\ < 1 — E[(/)] ^ as — > oo, from which the result unfolds. 
Using the integration by parts formula, we first obtain 



E 


</> 


'Y*Y ~ ' 
Qi 








n 


pq 



c„E 



ittj>T 



E 



Y*Y 



Qi 



pq 



E 



^ P r ^ 



j=l a=l 



Y*Y 



where 



Y* a.di{il;)ilj'Y 



DQi 











+ E 


- pq 




n 







Y* &d]{ip)xl;'Y 



itFe'*'^^ 



pq 



and where we denoted Xa the column a of matrix X , X* being the row vector 



With^, =0iTri?Q„ /3, -/3, 
In + piQi, we obtain 



m 



ft 



Pi(l + E[/3i])-c„ d 

p r 



'p) E [4'iQi], 



-E 
where 



, and with the relation n ^Y*YQi 

= -%-g)(l+E[/3i])E [06'*"^^] 
Y*Y 



J = l a=l 



^n,pq ~ ^n,pq 



-Qj{Mj)a 



/3i 



Y*Y 



-Qi 



Dividing each side by pi(l + E[/3i]) — c„ dp, then multiplying by {Mi)p and (Mi)g, 
and summing over p, q gives 



E[0Tr(M*QiAfi)e'*^^] = -(1 + E[/?i])E[(/.e*"'] Tt{M*Ap,Mi 



2 jt^r 
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with Ap^ = (p,(l +E[/3,])/„ - CnOy^, and 

with {E')pq = s'pq. From dHI), the identity n^^Y*YQj = In+PjQj, and LcmmaH31 
we finally obtain 



E 



)Tr(A/i*QiMi)e' 



E[(/i, 



TrMiTiMi 



1 ^ 



Tr A'L 



1 1+^, 



lvLM*T,DTiMi 



with Ti = T{pi), from which 



E 



E[(^e'*'*r]TrifiriMi 



0Tr(A/*QiAfi)e 

»tE[0e'*^r] P Cr,pirnn{pi)pjrn„{pj)TrM;fiDfjMjM*fjDfiAh 



E 



^" 1- CnPimnipi)pjmn{pj)j^TrDTiDTj 

It remains to show that — 0{n~^). We have explicitly 



0{n- 



1 



n 



Tr MlAp, 



y*adj(V')V''i^ 



3iTr(Af*Ap,^QiMi 



DQiMi ) (1 



(j)ttT)e 



it<j>T 



Using the fact that |e'*'^^| = 1 and the relation n~'^Y*YQi piQi + /„, the 
second term is easily shown to be 0(ri~^) from the Cauchy-Scwharz inequality and 
Lemma 14.31 If it were not for the factor F, the convergence of the first term would 
unfold from similar arguments as in the proof of Lemma 14.61 We only need to 
show here that E[|0Fp] = 0(1). But this follows immediately from Lemma and 
Lemma 14.51 

The generalization to J^i ^[4' Tr(Af*(5,iMi)e**'^'"] is then immediate and we have the 
expected result. 
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